Peripheral Binocular Imbalance in Anisometropic and Strabismic Amblyopia.

Purpose: Individuals with amblyopia experience central vision deficits, including loss of visual acuity, binocular vision, and stereopsis. In this study, we examine the differences in peripheral binocular imbalance in children with anisometropic amblyopia, strabismic amblyopia, and typical binocular vision to determine if there are systematic patterns of deficits across the visual field. Methods: This prospective cohort study recruited 12 participants with anisometropic amblyopia, 10 with strabismic amblyopia, and 10 typically sighted controls (age range, 5-18 years). Binocular imbalance was tested at 0°, 4°, and 8° eccentricities (4 angular locations each) using band-pass filtered Auckland optotypes (5 cycles per optotype) dichoptically presented with differing contrast to each eye. The interocular contrast ratio was adjusted until the participant reported each optotype with equal frequency. Results: Participants with anisometropic and strabismic amblyopia had a more balanced contrast ratio, or decreased binocular imbalance, at 4° and 8° eccentricities as compared with central vision. Participants with strabismic amblyopia had significantly more binocular imbalance in the periphery as compared with individuals with anisometropic amblyopia or controls. A linear mixed effects model showed a main effect for strabismic amblyopia and eccentricity on binocular imbalance across the visual field. Conclusions: There is evidence of decreased binocularity deficits, or interocular suppression, in the periphery in anisometropic and strabismic amblyopia as compared with controls. Notably, those with strabismic amblyopia exhibited more significant peripheral binocular imbalance. These variations in binocularity across the visual field among different amblyopia subtypes may necessitate tailored approaches for dichoptic treatment.

Road Hazard Stimuli: Annotated naturalistic road videos for studying hazard detection and scene perception.

Driving requires vision, yet there is little empirical data about how vision and cognition support safe driving. It is difficult to study perception during natural driving because the experimental rigor required would be dangerous and unethical to implement on the road. The driving environment is complex, dynamic, and immensely variable, making it extremely challenging to accurately replicate in simulation. Our proposed solution is to study vision using stimuli which reflect this inherent complexity by using footage of real driving situations. To this end, we curated a set of 750 crowd-sourced video clips (434 hazard and 316 no-hazard clips), which have been spatially, temporally, and categorically annotated. These annotations describe where the hazard appears, what it is, and when it occurs. In addition, perceived dangerousness changes from moment to moment and is not a simple binary detection judgement. To capture this more granular aspect of our stimuli, we asked 48 observers to rate the perceived hazardousness of 1356 brief video clips taken from these 750 source clips on a continuous scale. These ratings span the entire scale, have high interrater agreement, and are robust to driving history. This novel stimulus set is not only useful for understanding drivers' ability to detect hazards, but is also a tool for studying dynamic scene perception and other aspects of visual function. While this stimulus set was originally designed for behavioral studies, researchers interested in other areas such as traffic safety or computer vision may also find this dataset a useful resource.

Spatial variability in localization biases predicts crowding performance.

Visual processing varies substantially across individuals, and prior work has shown significant individual differences in fundamental processes such as spatial localization. For example, when asked to report the location of a briefly flashed target in the periphery, different observers systematically misperceive its location in an idiosyncratic manner, showing different patterns of reproduction error across visual field locations. In this study, we tested whether these individual differences may propagate to other stages of visual processing, affecting the strength of visual crowding, which depends on the spacing between objects in the periphery. We, therefore, investigated the relationship between observers' idiosyncratic biases in localization and the strength of crowding to determine whether these spatial biases limit peripheral object recognition. To examine this relationship, we measured the strength of crowding at 12 locations at 8° eccentricity, in addition to the perceived spacing between pairs of Gaussian patches at these same locations. These measurements show an association between variability in crowding strength and perceived spacing at the same visual field locations: at locations where a participant experienced stronger crowding, their perceived spacing was smaller, and vice versa. We demonstrate that spatial heterogeneity in perceived spacing affects observers' ability to recognize objects in the periphery. Our results support the idea that variability in both spatial sensitivity and bias contribute to variability in the strength of crowding and bolster the account that variability in spatial coding may propagate across multiple stages of visual processing.

Taking prevalence effects on the road: Rare hazards are often missed.

Previous work has shown that, in many visual search and detection tasks, observers frequently miss rare but important targets, like weapons in bags or abnormalities in radiological images. These prior studies of the low-prevalence effect (LPE) use static stimuli and typically permitted observers to search at will. In contrast, many real-world tasks, like looking for dangerous behavior on the road, only afford observers a brief glimpse of a complex, changing scene before they must make a decision. Can the LPE be a factor in in dynamic, time-limited moments of real driving? To test this, we developed a novel hazard-detection task that preserves much of the perceptual richness and complexity of hazard detection in the real world, while allowing for experimental control over event prevalence. Observers viewed brief video clips of road scenes recorded from dashboard cameras and reported whether they saw a hazardous event. In separate sessions, the prevalence of these events was either high (50% of videos) or low (4%). Under low prevalence, observers missed hazards at more than twice the rate observed in the high-prevalence condition. Follow-up experiments demonstrate that this elevation of miss rate at low prevalence persists when participants were allowed to correct their responses, increases as hazards become increasingly rare (down to 1% prevalence) and is resistant to simple cognitive intervention (participant prebriefing). Together, our results demonstrate that the LPE generalizes to complex perceptual decisions in dynamic natural scenes, such as driving, where observers must monitor and respond to rare hazards.

Normal blindness: when we Look But Fail To See.

Humans routinely miss important information that is 'right in front of our eyes', from overlooking typos in a paper to failing to see a cyclist in an intersection. Recent studies on these 'Looked But Failed To See' (LBFTS) errors point to a common mechanism underlying these failures, whether the missed item was an unexpected gorilla, the clearly defined target of a visual search, or that simple typo. We argue that normal blindness is the by-product of the limited-capacity prediction engine that is our visual system. The processes that evolved to allow us to move through the world with ease are virtually guaranteed to cause us to miss some significant stimuli, especially in important tasks like driving and medical image perception.

Effects of temporal and spatiotemporal cues on detection of dynamic road hazards.

While driving, dangerous situations can occur quickly, and giving drivers extra time to respond may make the road safer for everyone. Extensive research on attentional cueing in cognitive psychology has shown that targets are detected faster when preceded by a spatially valid cue, and slower when preceded by an invalid cue. However, it is unknown how these standard laboratory-based cueing effects may translate to dynamic, real-world situations like driving, where potential targets (i.e., hazardous events) are inherently more complex and variable. Observers in our study were required to correctly localize hazards in dynamic road scenes across three cue conditions (temporal, spatiotemporal valid and spatiotemporal invalid), and a no-cue baseline. All cues were presented at the first moment the hazardous situation began. Both types of valid cues reduced reaction time (by 58 and 60 ms, respectively, with no significant difference between them, a larger effect than in many classic studies). In addition, observers' ability to accurately localize hazards dropped 11% in the spatiotemporal invalid condition, a result with dangerous implications on the road. This work demonstrates that, in spite of this added complexity, classic cueing effects persist-and may even be enhanced-for the detection of real-world hazards, and that valid cues have the potential to benefit drivers on the road.

Gravitational effects of scene information in object localization.

We effortlessly interact with objects in our environment, but how do we know where something is? An object's apparent position does not simply correspond to its retinotopic location but is influenced by its surrounding context. In the natural environment, this context is highly complex, and little is known about how visual information in a scene influences the apparent location of the objects within it. We measured the influence of local image statistics (luminance, edges, object boundaries, and saliency) on the reported location of a brief target superimposed on images of natural scenes. For each image statistic, we calculated the difference between the image value at the physical center of the target and the value at its reported center, using observers' cursor responses, and averaged the resulting values across all trials. To isolate image-specific effects, difference scores were compared to a randomly-permuted null distribution that accounted for any response biases. The observed difference scores indicated that responses were significantly biased toward darker regions, luminance edges, object boundaries, and areas of high saliency, with relatively low shared variance among these measures. In addition, we show that the same image statistics were associated with observers' saccade errors, despite large differences in response time, and that some effects persisted when high-level scene processing was disrupted by 180° rotations and color negatives of the originals. Together, these results provide evidence for landmark effects within natural images, in which feature location reports are pulled toward low- and high-level informative content in the scene.

A dichoptic feedback-based oculomotor training method to manipulate interocular alignment.

Strabismus is a prevalent impairment of binocular alignment that is associated with a spectrum of perceptual deficits and social disadvantages. Current treatments for strabismus involve ocular alignment through surgical or optical methods and may include vision therapy exercises. In the present study, we explore the potential of real-time dichoptic visual feedback that may be used to quantify and manipulate interocular alignment. A gaze-contingent ring was presented independently to each eye of 11 normally-sighted observers as they fixated a target dot presented only to their dominant eye. Their task was to center the rings within 2° of the target for at least 1 s, with feedback provided by the sizes of the rings. By offsetting the ring in the non-dominant eye temporally or nasally, this task required convergence or divergence, respectively, of the non-dominant eye. Eight of 11 observers attained 5° asymmetric convergence and 3 of 11 attained 3° asymmetric divergence. The results suggest that real-time gaze-contingent feedback may be used to quantify and transiently simulate strabismus and holds promise as a method to augment existing therapies for oculomotor alignment disorders.

Perceptual effects of unequal saccadic adaptation produced by a dichoptic step.

The binocular coordination of eye movements in a three-dimensional environment involves a combination of saccade and vergence movements. To maintain binocular accuracy and control in the face of sensory and motor changes (that occur with e.g., normal aging, surgery, corrective lenses), the oculomotor system must adapt in response to manifest visual errors. This may be achieved through a combination of binocular and monocular mechanisms, including the recalibration of saccade and vergence amplitudes in response to different visual errors induced in each eye (Maiello, Harrison, & Bex, 2016). This work has used a double-step paradigm to recalibrate eye movements in response to visual errors produced by dichoptic target steps (e.g., leftward in the left eye and rightward in the right eye). Here, we evaluated the immediate perceptual effects of this adaptation. Experiment 1 measured localization errors following adaptation by comparing the apparent locations of pre- and postsaccadic probes. Consistent with previous work showing localization errors following saccadic adaptation, our results demonstrated that adaptation to a dichoptic step produces different localization errors in the two eyes. Furthermore, in Experiment 2, this effect was reduced for a vergence shift in the absence of a saccade, indicating that saccade programming is responsible for a large component of this illusory shift. Experiment 3 measured postsaccadic stereopsis thresholds and indicated that, unlike localization judgments, adaptation did not influence stereoacuity. Together, these results demonstrate novel dichoptic visual errors following oculomotor adaptation and point to monocular and binocular mechanisms involved in the maintenance of binocular coordination.

Looking ahead: When do you find the next item in foraging visual search?

Many real-world visual tasks involve searching for multiple instances of a target (e.g., picking ripe berries). What strategies do observers use when collecting items in this type of search? Do they wait to finish collecting the current item before starting to look for the next target, or do they search ahead for future targets? We utilized behavioral and eye-tracking measures to distinguish between these two possibilities in foraging search. Experiment 1 used a color wheel technique in which observers searched for T shapes among L shapes while all items independently cycled through a set of colors. Trials were abruptly terminated, and observers reported both the color and location of the next target that they intended to click. Using observers' color reports to infer target-finding times, we demonstrate that observers found the next item before the time of the click on the current target. We validated these results in Experiment 2 by recording fixation locations around the time of each click. Experiment 3 utilized a different procedure, in which all items were intermittently occluded during the trial. We then calculated a distribution of when targets were visible around the time of each click, allowing us to infer when they were most likely found. In a fourth and final experiment, observers indicated the locations of multiple future targets after the search was abruptly terminated. Together, our results provide converging evidence to demonstrate that observers can find the next target before collecting the current target and can typically forage one to two items ahead.

Effects of temporal frequency on binocular deficits in amblyopia.

Amblyopia is associated with a range of well-known visual spatial deficits, which include reduced contrast sensitivity, spatial distortions, interocular suppression, and impaired stereopsis. Previous work has also pointed to deficits in processing dynamic visual information, but it is unknown whether these deficits influence performance under binocular conditions. We examined the effects of temporal modulation on contrast sensitivity and binocular interactions in a preliminary study of 8 adults with amblyopia and 14 normally-sighted control subjects. For each observer, we measured interocular balance and stereopsis thresholds with binocular flicker across a range of four temporal (0, 4, 7.5, and 12 Hz) and spatial (1, 2, 4, and 8 cpd) frequencies. Interocular balance was estimated by varying the relative contrast of dichoptic letter pairs to produce perceptual reports of each letter with equal frequency, and stereopsis thresholds were measured by determining the minimum disparity at which subjects identified a front-depth target with 75% accuracy. Consistent with previous findings, we observed greater interocular imbalance and impaired stereoacuity at high spatial frequencies in amblyopes. In contrast, the effects of temporal frequency on performance were smaller: across both groups, interocular imbalance was largest at mid-to-low temporal frequencies, and stereopsis thresholds were unaffected by temporal frequency. Our results suggest that there may be a previously unreported effect of temporal frequency on interocular balance, as well as a possible dissociation between the effects of flicker on interocular balance and stereopsis.

Detection of brake lights while distracted: Separating peripheral vision from cognitive load.

Drivers rarely focus exclusively on driving, even with the best of intentions. They are distracted by passengers, navigation systems, smartphones, and driver assistance systems. Driving itself requires performing simultaneous tasks, including lane keeping, looking for signs, and avoiding pedestrians. The dangers of multitasking while driving, and efforts to combat it, often focus on the distraction itself, rather than on how a distracting task can change what the driver can perceive. Critically, some distracting tasks require the driver to look away from the road, which forces the driver to use peripheral vision to detect driving-relevant events. As a consequence, both looking away and being distracted may degrade driving performance. To assess the relative contributions of these factors, we conducted a laboratory experiment in which we separately varied cognitive load and point of gaze. Subjects performed a visual 0-back or 1-back task at one of four fixation locations superimposed on a real-world driving video, while simultaneously monitoring for brake lights in their lane of travel. Subjects were able to detect brake lights in all conditions, but once the eccentricity of the brake lights increased, they responded more slowly and missed more braking events. However, our cognitive load manipulation had minimal effects on detection performance, reaction times, or miss rates for brake lights. These results suggest that, for tasks that require the driver to look off-road, the decrements observed may be due to the need to use peripheral vision to monitor the road, rather than due to the distraction itself.

Predicting road scenes from brief views of driving video.

If a vehicle is driving itself and asks the driver to take over, how much time does the driver need to comprehend the scene and respond appropriately? Previous work on natural-scene perception suggests that observers quickly acquire the gist, but gist-level understanding may not be sufficient to enable action. The moving road environment cannot be studied with static images alone, and safe driving requires anticipating future events. We performed two experiments to examine how quickly subjects could perceive the road scenes they viewed and make predictions based on their mental representations of the scenes. In both experiments, subjects performed a temporal-order prediction task, in which they viewed brief segments of road video and indicated which of two still frames would come next after the end of the video. By varying the duration of the previewed video clip, we determined the viewing duration required for accurate prediction of recorded road scenes. We performed an initial experiment on Mechanical Turk to explore the space, and a follow-up experiment in the lab to address questions of road type and stimulus discriminability. Our results suggest that representations which enable prediction can be developed from brief views of a road scene, and that different road environments (e.g., city versus highway driving) have a significant impact on the viewing durations drivers require to make accurate predictions of upcoming scenes.

Binocular temporal visual processing in myopia.

Our ability to utilize binocular visual information depends on the visibility of the retinal images in each eye, which varies with both their spatial and temporal frequency content. Although the effects of spatial information on binocular function have been established, the effects of temporal frequency on binocularity are less well understood. These factors may also vary with refractive error if spatiotemporal sensitivity is affected by structural changes during the emmetropization process that may differentially affect distinct ganglion cells. In a cross-sectional study, we evaluated the potential effects of temporal and spatial frequency on binocularity in young individuals with emmetropia or myopia. Stereopsis and binocular balance were measured as a function of temporal (0-12 Hz) and spatial (1-8 c/deg) frequency. Stereopsis thresholds were measured by determining the minimum disparity at which subjects accurately identified the depth of bandpass-filtered rings. Binocular balance was measured by determining the relative contrast at which subjects reported dichoptic bandpass-filtered letters with equal frequency. Stereopsis thresholds were temporal but not spatial frequency dependent whereas binocular balance was spatial and temporal frequency dependent. There were no differences in monocular spatiotemporal contrast sensitivity between refractive groups in our sample. However, individuals with myopia showed reduced stereopsis with flickering stimuli and greater binocular imbalance at higher spatial and lower temporal frequencies compared to emmetropes. Differences in binocular vision between emmetropia and corrected myopia depend on temporal as well as spatial frequency and may be the cause or consequence of abnormal emmetropization during visual development.

Serial dependence in position occurs at the time of perception.

Observers perceive objects in the world as stable over space and time, even though the visual experience of those objects is often discontinuous and distorted due to masking, occlusion, camouflage, or noise. How are we able to easily and quickly achieve stable perception in spite of this constantly changing visual input? It was previously shown that observers experience serial dependence in the perception of features and objects, an effect that extends up to 15 seconds back in time. Here, we asked whether the visual system utilizes an object's prior physical location to inform future position assignments in order to maximize location stability of an object over time. To test this, we presented subjects with small targets at random angular locations relative to central fixation in the peripheral visual field. Subjects reported the perceived location of the target on each trial by adjusting a cursor's position to match its location. Subjects made consistent errors when reporting the perceived position of the target on the current trial, mislocalizing it toward the position of the target in the preceding two trials (Experiment 1). This pull in position perception occurred even when a response was not required on the previous trial (Experiment 2). In addition, we show that serial dependence in perceived position occurs immediately after stimulus presentation, and it is a fast stabilization mechanism that does not require a delay (Experiment 3). This indicates that serial dependence occurs for position representations and facilitates the stable perception of objects in space. Taken together with previous work, our results show that serial dependence occurs at many stages of visual processing, from initial position assignment to object categorization.

Unifying Visual Space Across the Left and Right Hemifields.

Visual space is perceived as continuous and stable even though visual inputs from the left and right visual fields are initially processed separately within the two cortical hemispheres. In the research reported here, we examined whether the visual system utilizes a dynamic recalibration mechanism to integrate these representations and to maintain alignment across the visual fields. Subjects adapted to randomly oriented moving lines that straddled the vertical meridian; these lines were vertically offset between the left and right hemifields. Subsequent vernier alignment judgments revealed a negative aftereffect: An offset in the same direction as the adaptation was required to correct the perceived misalignment. This aftereffect was specific to adaptation to vertical, but not horizontal, misalignments and also occurred following adaptation to movie clips and patterns without coherent motion. Our results demonstrate that the visual system unifies the left and right halves of visual space by continuously recalibrating the alignment of elements across the visual fields.

Stable individual signatures in object localization.

Perceptual processes in human observers vary considerably across a number of domains, producing idiosyncratic biases in the appearance of ambiguous figures [1], faces [2], and a number of visual illusions [3-6]. This work has largely emphasized object and pattern recognition, which suggests that these are more likely to produce individual differences. However, the presence of substantial variation in the anatomy and physiology of the visual system [4,7,8] suggests that individual variations may be found in even more basic visual tasks. To support this idea, we demonstrate observer-specific biases in a fundamental visual task - object localization throughout the visual field. We show that localization judgments of briefly presented targets produce idiosyncratic signatures of perceptual distortions in each observer and suggest that even the most basic visual judgments, such as object location, can differ substantially between individuals.

Fast ensemble representations for abstract visual impressions.

Much of the richness of perception is conveyed by implicit, rather than image or feature-level, information. The perception of animacy or lifelikeness of objects, for example, cannot be predicted from image level properties alone. Instead, perceiving lifelikeness seems to be an inferential process and one might expect it to be cognitively demanding and serial rather than fast and automatic. If perceptual mechanisms exist to represent lifelikeness, then observers should be able to perceive this information quickly and reliably, and should be able to perceive the lifelikeness of crowds of objects. Here, we report that observers are highly sensitive to the lifelikeness of random objects and even groups of objects. Observers' percepts of crowd lifelikeness are well predicted by independent observers' lifelikeness judgements of the individual objects comprising that crowd. We demonstrate that visual impressions of abstract dimensions can be achieved with summary statistical representations, which underlie our rich perceptual experience.

Age-related differences in the legibility of degraded text.

Aging-related changes in the visual system diminish the capacity to perceive the world with the ease and fidelity younger adults are accustomed to. Among many consequences of this, older adults find that text that they could once read easily proves difficult to read, even with sufficient acuity correction. Building on previous work examining visual factors in legibility, we examine potential causes for these age-related effects in the absence of other ocular pathology. We asked participants to discriminate words from non-words in a lexical decision task. The stimuli participants viewed were either blurred or presented in a noise field to simulate, respectively, decreased sensitivity to fine detail (loss of acuity) and detuning of visually selective neurons. We then use the differences in performance between older and younger participants to suggest how older participants' performance could be approximated to facilitate maximally usable designs.